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The cascade and parallel realizations of an arbitrary digital filter are 
both formed using second order sections as building blocks. This simple 
recursive filter is commonly implemented using 2's complement arithmetic 
for the addition operation. Overflow can then occur at the adder and the 
resulting nonlinearity causes self -oscillations in the filter. The character 
of the resulting oscillations for the second order section are here analyzed 
in some detail. A simple necessary and sufficient condition on the feedback 
tap gains to insure stability, even with the presence of the nonlinearity, is 
given although for many desired designs this will be too restrictive. A 
second question studied is the effect of modifying the "arithmetic" in order 
to quench the oscillations. In particular it is proven that if the 2's comple- 
ment adder is modified so that it "saturates" when overflow occurs, then no 
self-oscillations will be present. 

I. INTRODUCTION 

A digital filter using idealized operations can easily be designed to be 
stable. 1 Nevertheless, in actual implementations, the output of such a 
stable filter can display large oscillations even when no input is present.* 
A known cause of this phenomenon is the fact that the digital filter 
realization of the required addition operation can cause overflow, 
thereby creating a severe nonlinearity. f Our purpose here is twofold. 
The first is to give a somewhat detailed analysis of the character of the 
oscillations when the filter is a simple second order recursive section with 
two feedback taps. This unit is the fundamental building block for the 
cascade and the parallel realization of digital filters, and as such is 
worthy of some scrutiny. 2 A simple conclusion which one can draw from 

* To the best of our knowledge, these oscillations were first observed and diagnosed 
bv L. B. Jackson of Bell Telephone Laboratories. 

" t In the present work rounding errors in multiplication or storage are neglected 
and therefore so are the little-understood oscillations attendant upon these non- 
linearities. 
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the analysis is that the design of many useful filters requires using values 
of feedback coefficients such that the threat of oscillations is always 
present (with 2's complement arithmetic) . Optimum solutions that cope 
with this state of affairs are still unknown. Some recent proposals include 
observing when overflow at the adder is to occur and then taking ap- 
propriate action. Our second purpose, then, is to discuss the effectiveness 
of some of these ideas, and to give a proof that modifying 2's complement 
arithmetic so that the adder "saturates" is an effective way to eliminate 
the oscillations. Questions of how this nonlinearity will affect the desired 
outputs from a particular ensemble of input signals are not yet answered 
however, and perhaps for some applications other solutions need be 
considered. 

II. PROBLEM FORMULATION AND GENERAL DISCUSSION 

As explained in the introduction, this paper deals primarily with the 
simple structure shown in Fig. 1. The outputs of the registers, which 
are storage elements with one unit of delay, are multiplied bj r coef- 
ficients a and b respectively, fed back, and "added" to the input in the 
accumulator. No round-off error is considered either in multiplication 
or storage, but overflow of the accumulator is not neglected. In other 
words, the accumulator will perform as a true adder if the sum of its 
inputs is in some range; otherwise a nonlinear behavior is observed. 

Figure 2 shows the instantaneous input-output characteristic f(v) 
of the device motivated by using 2's complement arithmetic. It is also 
important to note that there is no memory of the accumulator for 
past outputs; that is, the device is zeroed after the generation of each 
output. 

If we let x(t) be the input signal to the device, y(t) the output, and 
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Fig. 1 — Basic configuration for the digital filter -j/* + 2 = f[ayk + i + by^ + £*+»]. 



OVERFLOW OSCILLATIONS 



3001 




Fig. 2 ■ — Instantaneous transfer function of the accumulator. 



/(•) the nonlinear characteristic of the accumulator, we have the basic 
equation 

y(t + 2) = j[ay(t + 1) + by(t) + x(t + 2)]. (1) 

We shall be concerned with the self-sustaining oscillations of the device 
that are observed even when no input is present [x(t) = 0], and when 
linear theory would predict the device to be stable. 

By making this linear approximation f(v) = v, the linearized version 
of equation (1) becomes, with no driving term in the equation, 

y(t + 2) - ayit + 1) - by(t) = 0. (2) 

The roots of the characteristic equation for equation (2) are 



Pi. 2 — 



a± (a 2 + 46)* 



2 



(3) 



and the region of linear stability corresponds to the requirement that 
| p,- | < 1. This region is depicted as a subset of the a-b plane in Fig. 3. 
One has | p,- | < 1 if and only if one is within the large triangle shown in 
Fig. 3. For this situation any solution of (2) will damp out to zero after 
a sufficient period of time. Now note that (2) is not necessarily a valid 
reduction of (1) even when z(t) = 0. The output, by choice of /, has been 
assumed to be constrained to be less than unity, but this is not sufficient 
to guarantee that the argument of the function / is less than unity. For 
this to be the case we require 



ay(l + 1) + by(t) | < 1. 



(4) 



Since | y(t) \ < 1, equation (4) will always be satisfied provided that 

I a, | + | b | < 1. (5) 
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Fig. 3 — Some interesting regions in the "space" of feedback tap weights. The hatching 
indicates stability even with the nonlinearity. 

The subset of the a-b plane for which (5) is true is shown in Fig. 3 
with vertical hatching, and is a subset of the region of linear stability. 
It is shown in this Section that if (5) is not satisfied there always exist 
self -sustained oscillations of the digital filter and hence (5) is both a 
necessary and sufficient condition for absence of self-sustained oscilla- 
tions.* One way to avoid the oscillations in question is simply to impose 
the requirement (5). This trick has its limitations, however, for it clearly 
restricts design capabilities. The region of the s-plane which is shaded 
in Fig. 4 shows the allowable pole positions. Roughly speaking, one con- 
cludes that there are desirable filter characteristics that can be realized 
with this restriction and there are desirable characteristics that cannot. 

It is not our purpose here to outline those applications for which (5) 
will not be restrictive; we proceed to sketch the situation when | a | + 
| b | > 1 and the threat of oscillation is present. Sections III and IV 
contain, we believe, a novel and interesting mathematical treatment of 
the general problem of classifying the self -oscillations of the nonlinear 
difference equation (1). However, for the user of digital niters a simple 
proof of the | a | + | b \ > 1 being sufficient for threat of oscillations is 
of more immediate interest. After reading the simple proof of this fact 
given next in the present section, such a reader may wish to proceed 
directly to Section V. 

Consider the possibility of undriven nonlinear operation giving a dc 



* I. W. Sandberg has informed the authors that the necessity and sufficiency of 
(5) holding for absence of oscillations has also been obtained jointly by him and 
L. B. Jackson. 
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output, that is, y k = y for all k. Equation (1), with x(t) = becomes 
y = /[(a + b)y]. Assuming for defmitness that y > 0, we can easily see 
from Fig. 2 that the above equation will be true if (a + b)y - y — 2, 
which implies y = 2/(1 — a — b). One can show (see discussion follow- 
ing equation 17), that this y will have magnitude < 1 provided only 
that the tap values a and b lie in the region labeled I in Fig. 3. Thus a 
consistent dc oscillation is always possible for all (a, 6) pairs in this 
region. Next consider the possibility of a period 2 oscillation. This 
amounts to finding a consistent solution to y = /[(& — a)y\. Proceeding 
as before we obtain 



V = 



1 + a - b 



Thus y k will be given by (— l) k y, and will have magnitude less than unity 
if the (a, 6) pair lies anywhere in region II of Fig. 3. 

III. FURTHER ANALYSIS OF THE OSCILLATIONS 

To analyze equation (1) in greater detail, it is very convenient to 
write it in the form similar to (2) , 

y(t + 2) - ay(t + 1) - by(t) = £ a.u(t + 2 - n), (6) 



|ri,n (3-2V"2! 




Fig. 4 — Pole locations in the s-plane (shaded region) realizable under the constraint 

that la I + 161 < 1. 



3004 THE BELL SYSTEM TECHNICAL JOURNAL, NOVEMBER 1969 

where u(t) is a square pulse of unit height that one may conveniently 
think of as lasting from t = until t = 1. This, of course, means that 
one interprets the solution of (6) to be a piecewise constant function 
like the actual output of the digital filter. For mathematical manipula- 
tions it is sometimes desirable to also interpret (6) as a difference equa- 
tion, defined only for integer t. In this case one would write that u(t — n) 
= 5 (n where 5 (n is the familiar Kroneker symbol. 

The point of the right side of (6) is simply to keep | f(v) | < 1 re- 
gardless of what value v has. From Fig. 2 we see that if | v \ < 1, this 
added term is not needed and we take a n = 0. If 1 < v < 3 then we take 
a„ = — 2, and if— 3<u<— lwe take a n = +2. Since we have that 
| y(t) | < 1 and that linear stability (see Fig. 3) implies | a \ < 2, | b \ < 1, 
we need not consider further values of \v\. Thus in (6) a n = 0, ±2 
depending on whether or not v(t) = ay(t + 1) + by(t) crosses the lines 
v = ±1. It will be convenient to have a word for such crossings; we 
shall call them "clicks", borrowing a favorite word from FM theory. 
Then a n = 0, ±2 depending on whether or not a click does not, or does, 
occur. 

Note if one knew what the click sequence {a„} was, one could solve 
(6) simply by using the clicks to be the driving term for a linear equation. 
We are mainly interested in describing the self-sustained steady state 
oscillations of arbitrary period N. Hence initial conditions will play no 
essential role for us, for while they determine which oscillating mode 
appears as t — » °o , they play no role in describing the modes. Our pro- 
cedure will be as follows: 

(i) Assume a click sequence of period AT; 

dlN+k = 0>k • t = 0, 1, • • ' /y\ 

g k < N - 1. 

(ii) Using the assumed {a n }, find the steady state solution of (6). 
However, only solutions that have \y(t)\ < 1 for all t are allowed, 
(m) Check that this steady state solution actually generates the as- 
sumed click sequence. 

In carrying out the above program for some simple cases we observed 
that step Hi never seemed to yield anything new. Indeed, surprising as 
it seems at first glance, step in never has to be carried out. If one obtains 
a solution with j y(t) \ < 1, this solution is consistent. That is, it auto- 
matically generates the assumed click sequence. The proof is simple. 
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One calculates the argument of the function / from (6) : 

ay(t + 1) + by(t) = y(t + 2) - £ «»«(* + 2 - ")• (8) 

We have a click at time t + 2 = m if | a?/(m - 2) + by(m - 1) | > 1. 
From (8), 

| ay(m - 2) + by(m - 1) | = 1 y(m) - a m |. (9) 

Note then if in (9) a m = 0, then | a?/(?n - 2) + 6y(??i - 1) | = | y(m) \ 
< 1; thus if there is no click at a particular time in the assumed click 
sequence the "solution" will not generate one. Next assume a m = +2; 
then 

ay(m - 2) + by{m - 1) = y{m) -2 < -1, (10) 

where we use | y(t) \ < 1 again. Equation (10) says if a positive click 
is present in the assumed click sequence then the solution obtained from 
the linear equation (6), given by this click sequence, will reproduce the 
positive click. Obviously the same argument holds for a negative click, 
a m = —2, and the proof of this point is complete. 

The steady-state solution of our fundamental equation (6) for an 
arbitrary click sequence {a„,} of period N is derived in the appendix. 
If we define 

Am J-) = L ajT (ID 

and 

D(z) = z 2 - az-b, (12) 

and let r< , i = 1, • • • , N, be the N Nth. roots of unity, then the (periodic) 
output values are given by 

i n An-i\~J 

«--s §-#•*• <13) 

The above expression gives the \y k ) output sequence for any click se- 
quence. We emphasize, however, that it is only a solution correspond- 
ing to a self-sustained oscillation of the digital filter if we have \y k \ < 1, 
all k. Whether or not this is true depends on the particular click sequence 
assumed. 

Another form of the solution can be obtained by manipulation of (13). 
To write this down, define 

6<« m (a fc _ x _ B + d k ^. n+N )/2, (14) 
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where we understand a,- = if j does not lie between and N — 1, 
inclusive, and d, = a, if it does. One of the a's in (14) will thus always be 
zero and b l n k) has values of ±1, 0. The other form of the solution is then 

y" = r^"T 2* bn 1 » - i * 

Pl — P2 n-0 LI — p t 1 — p 2 J 

fc = 0,1, ••• ,tf- 1 (15) 

where p< are given in (3). 

In (15) we have N vectors of dimension N, namely the {K k) \ k = 
0, 1, 2, • • • , N — 1. Note from (14), however, that they are all cyclic 
permutations of one another. Hence we may refer to the b vector, b, of 
a solution, understanding that the b and all its cyclic permutations 
generate a solution in the sense of (15). Note that a cyclic permutation 
of the y k has no real significance here; it simply changes the origin of 

time. 

An interesting property of the solutions which we have written down 
follows from the fact that if we transform the point (a, b) in the aft-plane 
into another point by 

a^a'=-a (16a) 

b -^ b' = b 

then under this transformation 

Pi 

P2 



(16b) 



The property is this: Let N be an even integer and let b = (& j &i i ■ • • j 
btr-i) be a click vector generating a solution at point (a, b). Then the 
vector b' = (6 , -b, , b 2 , -b 3 , • • ■ , &*_,) generates a solution at 
reflected point (—a, 6). The proof is simple. Note from (15), 



V' W ■■ 



_ 2 ^ ,, (t )[" p." P? 1 

" P [- P ' 2 ^r ' " Li - P f ~ l - rfO 

-PlTPl n LI — p 2 1 — PiJ 

Hence if | y (k) \ < 1 then | y' w \ < 1. Note that the proof also supplies 
the value for y' m in terms of y Kk) '. This theorem will be used later to 
generate new solutions from old ones. 

Before leaving this general discussion in favor of exhibiting some 
solutions in the next section, we list a few more observations related 
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to the click vector b. The click vector b, whose only allowed component 
values are ±1,0, completely characterizes the associated oscillation. 
Clearly there can then only be a finite number of oscillations of given 
period N. This number is upper bounded by 3 N , but will generally be 
much less. Also note that a cyclic permutation of the components of b 
cyclically permutates the output values y k , and this latter is merely a 
shift in time. The permutated values are not physically distinct. 

Also note that if we perform b — > -b then y — > — y, and a solution 
of opposite sign is obtained. While this may often be distinguishable 
from the first solution, it is trivially related to it. Finally if one were to 
count the number b vectors of dimension N that yield new information, 
one would wish to exclude subperiods of N. Thus if (+, 0, 0) is an gen- 
erating b vector for period 3, (+, 0, 0, +, 0, 0) generates a period 6 
oscillation but this is not new information. We have not solved the prob- 
lem of counting how many of the 3 V vectors are left after we impose the 
requirements of cyclic shifts, sign changes, and subperiods. At any rate, 
it is essential to test the ones that remain to check that they generate 
allowed solutions, \y k \ < 1. 

IV. SOME EXPLICIT PERIODS AND REGIONS OF OSCILLATION 

Now for a few explicit solutions. Consider the possibility of a dc 
"oscillation", namely, set N = 1. The only nontrivial click vector is 
b = (+). The solution is more immediate if we use (13). We have 

« = —l— b (17) 

for the dc value of output. For what values of a and b within the triangle 
of Fig. 3 will we have \y\ < 1? We require 

| 1 - a - b | > 2 (IS) 

which is equivalent to either 

1 - a - b > 2 (19a) 

or 

-1 + a + b > 2. (19b) 

Inequality (19a) (coupled with the linear stability requirement) defines 
the triangle labeled "I" in Fig. 3, while (19b) is outside the stability 
region and needs no further consideration. Thus any portion of the 
region a < that we have not excluded from oscillations has now been 
shown to have them. They are of period 1; other period oscillations may 
(and do) occur in this region. 
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At this point it is amusing to use an earlier remark on the possibility 
of generating new solutions from an even period one by "reflection". 
Letting N = 2, the click vector b = (+, +) certainly generates a period 
2 oscillation (albeit one with subperiods) in region /. Then the click vec- 
tor b = (+, — ) generates something really new: a period 2 oscillation 
in the region labeled II in Fig. 3. The amplitudes of the output are 

r-l-Vj+Tzj. ->o. (20 

One more possibility of a click vector exists for period 2, and that is 
b = (4-, 0). From (13) we write for possible output values 

1 I 1 

ft = i 1 Z + 



* — a — b 1 + a — b ^ 

= 1^ 1 

Vl 1 - a - 6 l + a-6' 

After a little uninteresting analysis one can conclude that we cannot 
have | ft | < 1, [ ft | < 1 in (21) for any allowed values of a and b. Thus 
there are no other period 2 oscillations. 

On to period 3. Now there are four click vectors which must be con- 
sidered. These are (+00), (++0), (H — 0), (+ + -). Even in this case 
an exhaustive check that the "solutions" generated are legitimate ones is 
trying. Therefore, we resort to a trick; we look for periods which may 
exist in the immediate neighborhood of the point (a = 0, b = 1). This 
means pi = i, p 2 = —i. In this immediate neighborhood p 2 = p* u and 
(15) reads 

»-&■.**%&• (22) 

where we have let 2 = p, . Letting N = Z, z = i gives 
y = —60 + 61 + 62 
ft = -61 + 6 2 + 6 (23) 

ft = —6a + 6 + &| • 

We now require y k = ±1 as a test for the click vector b. We see that 
only (+00) qualifies as possibly yielding a solution in the neighborhood 
of (a — 0, 6 = —1). A computer study shows that indeed the solution 
extends into the interior of the triangle and the region found is shown 
in Fig. 5. This immediately implies existence of the period 6 oscillation 
generated by (+00—00) in the reflected region. Similarly, a period 5 
oscillation region (with the concomitant period 10) generated by 
(+0000) is shown in Fig. 6. 
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-1.0 -0.9 -0.8 -0.7 -0.6 

b 
Fig. 5 — A region for period 3 oscillations. 



It is very tempting to conjecture that the point (a = 0, b = — 1) is a 
boundary point of any allowed region of oscillation. If this is true, a 
procedure like that used above may eliminate some otherwise very 
respectable b vectors from consideration. Note that for N = 2, 6 = 
( + ,0) satisfies the required condition at p t = i, but we have shown this 



b 

-0.8 



-0.2 



2 



Fig. G — A region for period 5 oscillations. 
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OUTPUT = f (V) 




Fig. 7 — Zeroing arithmetic, shown above, also gives rise to oscillations. 

is not extendable into the interior of the triangle. Hence existence at 
z = i does not guarantee an allowed solution. 

V. STABILITY WITH A MODIFIED ARITHMETIC 

In an attempt to eliminate these oscillations, proposals have been 
made which rely on detecting overflow. One such suggestion dictates that 
when overflow occurs, the adder is directed to shift out zero. For ref- 
ereace we call this zeroing arithmetic. The effective transfer function of 
the adder for zeroing arithmetic is given in Fig. 7. However, it can be 
shown by numerical example that such a procedure still leads to oscil- 
lations. Another possibility, "saturation arithmetic," is displayed in 
Fig. 8. Here a one (with the appropriate sign) is put out when overflow 
is detected. The remaining portion of this paper is devoted to proving 
that saturation arithmetic leads to stable operation whenever linear 
theory would predict it to be so. 

To begin, we suppose for the moment that we ignore the fact that 
the digitally implemented adder is nonlinear. Then the second-order 
linear difference equation which governs the behavior of the undriven 
system has solutions y k which may be described as follows: 

Case 1 : Complex roots for characteristic equation 

y k = Re K exp ( — all), K and a complex, Re a > 0. 

k = 0, 1, 2, • • • . (24) 

Case 2: Real but unequal roots 

y k = K x exp {-ak) + K 2 exp (-0*). K< real; a > 0, > 0. (25) 
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Case 3: Real and equal roots 

y k = [K, + KJg] exp (-afc). K { real; a > 0. (26) 

Using this information, coupled with knowledge of t/, and y i+1 for some 
j, it is easy to give a bound on the magnitudes of all future (k ^ j) 
values of the output and to show this value goes to zero with increasing 
j. This is just another way to say that the solutions go to zero for the 
linear case. In the nonlinear case we cannot exclude the situation that 
some y k+ i will exceed unity and the nonlinearity will be operative. For 
saturation arithmetic the offending value must be set to unity if, for 
example, y k+l > +1. We can, for conceptual purposes, regard this as a 
"squeezing" of the output from a value greater than unity down to the 
value one which is performed in a continuous fashion. The crux of the 
proof now comes in showing that the partial derivative of our bound 
(on future outputs) with respect to the most recent output y k+1 has, for 
saturation arithmetic, the same sign as y k+1 . Hence decreasing a value 
that is too large in magnitude will decrease the bound as well, and it 
will go to zero at least as fast as it does for the linear case. 

To show how the above outline works, consider first the linear case 
with complex roots. From the form of the solution 

y k = Re K exp (-ak), Re a > 0, k = 0, 1, 2, • • ■ , 

it is clear that if we define 

B = \K \ 2 (27) 

then y\ ^ B for all k ^ 0. We now express B in terms of the values 
7/0,7/! which are initially stored in the shift registers to yield 

D 2 , \Vx ~ Vn Re exp (- a)] 2 (9R) 

B — y -\- Ft 7 \t2 ( -- 8 - ) 

'-' [Im exp (—a)] 

This suggests that one define the more general set of numbers 

n, = a + \n« -**"*. ;(-">]' . (29) 

' J ' [Im exp (— a) J 

Clearly, from the way that B, is defined, we have that 

y k = Re K i exp [-a(k - j)), k ^ j (30) 

where /<", is some appropriate complex number that satisfies 

B i = | Ki | 2 . (31) 

From (30), the additional inequality that y\ S -B, for all k ^ j follows. 
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Furthermore, one can see by comparing (30) and (24) that 

| K, | 2 = | K | 2 | exp (-«,") I 2 . (32) 

Hence, since the real part of a is positive, 5, goes monotonically to 
zero with increasing j. 

To generalize the above arguments to a nonlinear situation of in- 
terest,* consider the following equation which follows from (29) : 

V ' " - -fo« -V,Re exp (-«)]. (33) 



dy i+1 [Im exp (-a)] 

Now imagine B,-_ x has been calculated from values stored in the registers. 
From linear theory we predict y)+\ and B\ L) ^ -B,_i exp (—2a), by (32). 
Now if the y\+\ generated by the linear equation were too large, say, then 
decreasing it to unity would, according to (33), decrease the bound Bj if 
we knew that 

y l+I - y, Re [exp (-a)] ^ for ygj ^ y i + 1 £ y\°\ (34) 

where y)+\ is the linear prediction for y j+l and y\ c + \ is the correct value 
for the nonlinear circuit resulting from "squeezing" y\+\ down. Since 
| y,- | ^ 1 and Re exp (—a) < 1, (34) is always true for saturation 
arithmetic (see Fig. 8) because y\1\ = +1 (assuming y\^\ > +1) and 
(34) can never swing negative. Similar things happen, of course, if 
y i+1 < —1. Thus the bound decreases at least as fast as for the linear 
case (which is exponential) and stability is assured. For zeroing arith- 
metic y)l\ = 0, and thus the appropriate sign for (34) cannot be guar- 
anteed which is in satisfying agreement with the known instability for 
this case. 

For the next case of real but unequal roots, we now have reference to 
equation (25) and define our initial bound as 

B = 2(K\ + Kl) 

_ 9 [V\ ~ exp (-a)y ] 2 + [y l - exp (-0)y n f ,„ , 

[exp (-a) - exp (-/3)] 2 W 

The remaining details are too similar to those of the preceding ease to 
warrant recording again; stability for saturation arithmetic holds here 
as well. 

The last case to discuss occurs when we have real and equal roots. 



* Bj calculated from (29) is a bound on future outputs for the nonlinear as well as 
the linear case. If Bj < 1 the two cases coincide, while of Bj > 1 the conclusion 
follows equally trivially since |y*| < 1 for the nonlinear situation. 
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INPUT = V 



pi g- 8 — The above nonlinearity corresponds to saturation arithmetic and leads to 

stable behavior. 



This situation, represented for the linear equation by equation (26), 
is more difficult to treat than the previous ones. The analog of (27) and 
(35) now is 

\ak\ 

B = max -1^2 ■ ( 36 ) 

That (36) yields a bound follows from the facts that (for t ^ 0) 
yl ^ max [(K, + K 2 t) exp (-at)) 2 

^ 2 max [K 2 + K\t 2 } exp (-2at) 
t 

(max K 2 exp (—2at) 
max Kit 2 exp (—2at) 



^ 4 max , 



= 4 max . 



K 2 2 exp (-2) 
a' 



< 4 max 
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Since 

K\ (y l exp a - y Q f 



(37) 



we define our general bound as 
Bj = 4 max 



(y i+1 exp a - ytf 



(38) 



a 
Using the solution ?/,- = (K x + K 2 j) exp (— aj), we see that 



(39) 



decreases by the multiplicative factor exp (—2a) for every unit increase 
of j. Further, suppose that Bj = ty 2 for some j. That is, suppose 

(>,., expa - jrf < )fi 
a 

This implies 

V 2 i +i < V)(l + «) 2 exp (-2a), (41) 

and so if next time B i+1 = 4?/ 2 - +I , then we have decreased by 
(1 -f- a) 2 exp (—2a) < 1. On the other hand, if at the next step we have 
to choose B i+ i = 40,- +1 , we see 



B, y 2 



g-f 1 ^ exp (-2a). (42) 



Likewise if we go from 40,- to 40, +1 we decrease by exp (—2a). Finally, 
a "transition" from 40,- as a bound to 4=y 2 +1 decreases the bound by a 
multiplicative factor of (1 + a) 2 exp ( — 2a). To see this we note that, 
by assumption, 

= 4&,« expa - „]• ^ 

a 
Using the left-hand equahty in (43) implies 

|y, +1 | exp a fS^- + | y t |. (44) 
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m 



I yi I ^ ^- W 

Using (45) in (44) then allows us to deduce that 

B i+1 = 4f{„ £ (1 + a) 2 exp (-2a)3, (46) 

as was claimed. To extend these arguments to the nonlinear case we 
again observe that 

-^- ^ (47) 

for saturation arithmetic. 

VI. GENERALIZATIONS TO OTHER STABLE NONLINEARITIES 

Aside from the three nonlinearities already mentioned, there does 
not appear to be immediate engineering interest in seeing which other 
nonlinearities will or will not give rise to stable behavior of the filter. 
Having come this far, however, it is hard to resist asking if the method 
of proof we have used, or some slight extension of it, does suggest other 
nonlinearities for which stability will hold. The extension we consider 
is not to require 

ay'* 1 - 

all during the "squeezing" operation, but merely that 

B'; : - B c t ^ 0, (48) 

where B L t is the value of the bound using linear theory and B^ is the 
"correct"' value. An inspection of the previous proofs shows that this 
is equivalent to 

(tf« - WiY - (v? + i - "**? > ° (49) 

for all real a such that \a\ < 1. 

A little manipulation reduces (49) to 

<&. " rf*00*« + A. - 2 ^) ^ °- (50) 

Assuming y% +i > 0, the first term in (50) to be nonnegative, and | y k \ 
^ 1, makes it apparent that 

i&, + yL> * 2 (51) 
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is sufficient. The "stable nonlinearities" deduced from this kind of 
reasoning are outlined in Fig. 9. Thus any nonlinearity whose graph 
coincides with the identity function on the interval [—1, 1] and whose 
remaining portions lie in the closed shaded region of Fig. 9 will be stable. 
The function in these regions need not be continuous and need not obey 

An even higher degree of generality is achieved when we realize that 
nothing in our proofs required the nonlinearity j(u) to be the same for 
successive values of the parameter k. This is tantamount to allowing the 
nonlinearity to be random in the following manner. Suppose a value of 
Vk+i > 1 nas been predicted from linear theory (see Fig. 9). The per- 
pendicular P to the v axis through y% +1 intersects the shaded region 
shown in Fig. 9 along a line segment. Choose randomly from this line 
segment the "value" of the nonlinearity to give y c kJrX . The discussion in 
this Section shows that the solutions of the difference equation 

Vk+2 = f[ay k+l + by k ] (52) 

which has the stochastic nonlinearity just described will be stable when- 
ever the linear version has stable solutions. 

APPENDIX 

Derivation of the Steady-State Solution 

We obtain the steady-state solution of our fundamental equation (6) 
using z-transforms. Recall that if one has a bounded sequence of number 
{a„}, the z-transform is defined by 

Kz) = E a n z~ n (53) 

n-0 

where (53) converges and is analytic outside the unit circle, \z\ > 1. 
It is easy to show that if {a n } is periodic of period N, that is if aj, +n = a n , 
then (53) becomes 

1 - z 
where A N - X is the polynomial of degree (N — 1) in \/z given by 

A N J-) = f! ^z~ n . (55) 

\ZI „_ 

The N poles of f(z) at the N roots of unity are apparent from (12), and 
there are no other poles. 



m = - — -zw ( 54 ) 
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f(v) 
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Fig. 9 — Any nonlinearity whose graph coincides with the identity function on the 
interval [ — 1, +1] and whose remaining portions lie in the (closed) shaded region will 
be stable. The possibility of generalizing this to a stochastic nonlinearity is also noted 
in the text. 



Denoting by Y(z) the z-transform of y(t) excluding the additive terms 
involving initial conditions (since these will damp out because of linear 
stability) we have from (6) that 



Y(z) = 



Mi- 



(z 2 - az - 6)(1 - z~ N ) 



(56) 



The z-transform of the steady-state solution Y (z) must still be ex- 
tracted from Y(z). Since the unit circle | z | = 1 corresponds to the 
frequency axis if one were using Fourier transforms, we know, by anal- 
ogy, the state steady-state portion of (56) will be the pole-terms. Let 
r,- , i = 1, • ■ ■ , N be the N Nth roots of unity and define 



Wi . z 



1 - z 



1_ 

Ti 



Note (57) implies 



Q-' 1 - = Nr< . 



Then from (56)-(58) we have 



Hz) = E 



A »-\7, 



1 - -)-Nr r D(rd 

Ti Zl 



(57) 



(58) 



(59) 
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where we have let 

D(z) = z 2 - az - b. (60) 

Using (57) once more, the steady-state solution (59) may be written 



™ - r^i £ X.) • <61) 

Referring back to the discussion at the beginning of this section, we see 
that (61) is the ^-transform of a sequence {y k } of period N where 

= coefficient of g * in j-^ ^ £ 



y k - _ „ - [iV ^ ri D(r,) 

k = 0, 1, ••• ,N - 1. (62) 
Using (57) in (62) we obtain 

1 - ^(-J 

^tfS - ^)"""*' (63) 

where, in writing (63), we have used the fact that r" = 1. Expression 
(63) thus gives the {y k } sequence for any click sequence. It is a solution 
corresponding to a self-sustained oscillation of the digital filter only if 
we have \y k \ < 1, all k. 

Two sums appear in (63). The explicit one shown is the sum over the 
roots of unity; the hidden one is the polynomial A w _i(l/r<). We will 
exhibit another form of solution (63) by explicitly doing the sum over the 
N roots. We begin by writing 

A K JA =2 2$, Pi -±1,0. (64) 

Thus pi are the coefficients, except for the factor of 2, of the polynomial 
Ajf-iiz). We also write, by factoring D(z) and expanding in partial 
fractions, 



D(z) (z — pi)(z — p 2 ) p, — p 2 



_z — Pi 



- p 2 j 



(65) 



Now note that if z is such a number than z s — 1, we have (since | p | < 1 
and | 2 | = 1) 
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1 =!e(!). 



(66) 

z — p z ~ \z/ 

Let us look at the sum of the n = 0, N, 2N, etc., terms in the right side 
of (66), that is 

N 2N 3.V 

P P P 

1 + V + 2N + 3.V + • • • 

Z Z £ 



= 1 + p + p + p 



Treating the sum of terms 

n = 1,./V + 1.2JV + 1, 
n = 2, tf + 2, 2AT + 2. 



1-p' 



(67) 



n = tf - 1, AT + (N - 1), 2iV + (N - 1), 
similarly, we have 



1 



1 1 



z - P z l — p " L ^ 2 
Finally letting 2 = 1/r, gives 

1 r, 



a- 



•--, 1-.- 



v Z l><r. 



Using (65) and (64) in (63) yields 

-I e4'e?|) 

[~I V - f p " - pl W 
Lr, j&tfU - p" 1 - P ;/_ 



Pi — p 2 iy I v i-o "i 



(68) 



(69) 



(70) 



Two sums in (70) are immediately done. First look at the sum over the 
roots of unity. This involves observing that 



ErT" 



[N if k - / - 1 - n = mod N, 



(71) 



[0 otherwise. 
The congruence indicated in (71) can only be satisfied here it I = k — 



3020 THE BELL SYSTEM TECHNICAL JOURNAL, NOVEMBER 1969 

1 — n or if I = k — 1 — n + N. Thus it is useful to define 

2&<*> - «»_,_, + «»-i- + » , (72) 

where we understand a, : = if ; does not lie between and N — 1, in- 
clusive, and dj s a,- if it does. One of the a's in (72) will thus always be 
zero and b l n k) has values, like the p's, of ±1, 0. Using the discussion above 
surrounding equations (71) and (72) we perform next the sum over I 
and write another form of the solution: 



.) A'-l r n n ~| 

Pi P2 n-0 LI — p, 1 — p 2 _ 



fc - 0, 1, ••• ,N - 1. (73) 
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